Searching Image Content

ABSTRACT

A method, an apparatus and computer program code is provided. The method comprises: responding to user input by making at least one alteration to a recording of a real scene in a first image content item; determining at least one altered characteristic of the recording of the real scene; determining whether one or more further image content items, different from the first image content item, have a recording of a real scene comprising the at least one determined altered characteristic; and causing at least one further image content item, having a recording of a real scene comprising the at least one determined altered characteristic, to be indicated to a user.

TECHNOLOGICAL FIELD

Embodiments of the present invention relate to searching through imagecontent. In particular, they relate to searching through image contentitems using an altered characteristic of a recording of a real scene.

BACKGROUND

Image content items, such as static images and motion video, may becaptured by a camera. Such image content items may be displayed by adevice. The device may enable the user to browse through the imagecontent items.

BRIEF SUMMARY

According to various, but not necessarily all, embodiments of theinvention there is provided a method, comprising: responding to userinput by making at least one alteration to a recording of a real scenein a first image content item; determining at least one alteredcharacteristic of the recording of the real scene; determining that oneor more further image content items, different from the first imagecontent item, have a recording of a real scene comprising the at leastone determined altered characteristic; and causing at least one furtherimage content item, having a recording of a real scene comprising the atleast one determined altered characteristic, to be indicated to a user.

According to various, but not necessarily all, embodiments of theinvention there is provided computer program code that, when performedby at least one processor, causes the following to be performed:responding to user input by making at least one alteration to arecording of a real scene in a first image content item; determining atleast one altered characteristic of the recording of the real scene;determining that one or more further image content items, different fromthe first image content item, have a recording of a real scenecomprising the at least one determined altered characteristic; andcausing at least one further image content item, having a recording of areal scene comprising the at least one determined alteredcharacteristic, to be indicated to a user.

One or more computer programs may comprise the computer program code.The one or more computer programs may be stored on one or morenon-transitory computer readable mediums.

According to various, but not necessarily all, embodiments of theinvention there is provided an apparatus, comprising: means forresponding to user input by making at least one alteration to arecording of a real scene in a first image content item; means fordetermining at least one altered characteristic of the recording of thereal scene; means for determining that one or more further image contentitems, different from the first image content item, have a recording ofa real scene comprising the at least one determined alteredcharacteristic; and means for causing at least one further image contentitem, having a recording of a real scene comprising the at least onedetermined altered characteristic, to be indicated to a user.

According to various, but not necessarily all, embodiments of theinvention there is provided an apparatus, comprising: at least oneprocessor; and memory comprising computer program code configured to,with the at least one processor, cause at least the following to beperformed: responding to user input by making at least one alteration toa recording of a real scene in a first image content item; determiningat least one altered characteristic of the recording of the real scene;determining that one or more further image content items, different fromthe first image content item, have a recording of a real scenecomprising the at least one determined altered characteristic; andcausing at least one further image content item, having a recording of areal scene comprising the at least one determined alteredcharacteristic, to be indicated to a user.

According to various, but not necessarily all, embodiments of theinvention there is provided examples as claimed in the appended claims.

BRIEF DESCRIPTION

For a better understanding of various examples that are useful forunderstanding the detailed description, reference will now be made byway of example only to the accompanying drawings in which:

FIGS. 1A-1C and 2A-2C illustrate examples of mediated reality in whichFIGS. 1A, 1B, 1C illustrate the same virtual space and different pointsof view and FIGS. 2A, 2B, 2C illustrate a virtual scene from theperspective of the respective points of view;

FIG. 3A illustrates an example of a real space and FIG. 3B illustratesan example of a real scene that partially corresponds with the virtualscene of FIG. 1B;

FIG. 4A a schematic of an apparatus in the form of a chip or chipset;

FIG. 4B illustrates a schematic of an apparatus in the form of one ormore electronic devices that are operable to enable mediated realityand/or augmented reality and/or virtual reality;

FIG. 5 illustrates an example of a method for enabling mediated realityand/or augmented reality and/or virtual reality;

FIG. 6 illustrates an example of a method for updating a model of thevirtual space for augmented reality;

FIGS. 7A and 7B illustrate an example of an apparatus that enablesdisplay of at least parts of the virtual scene to a user;

FIG. 8 illustrates a flow chart of a method;

FIG. 9 illustrates a recording of a real scene in a first image contentitem, where the recording includes images of real objects from the realscene;

FIG. 10 illustrates a user beginning a gesture while the recording ofthe real scene is displayed by the display;

FIG. 11 illustrates the user completing the gesture that he began inFIG. 10;

FIG. 12 illustrates second, third and fourth image content items beingrepresented on a display after a search of image content items based onan altered characteristic of the recording of the real scene in thefirst image content item;

FIG. 13 illustrates a recording of a real scene in a fifth image contentitem;

FIG. 14 illustrates a user moving an image of a real object in the fifthimage content item to one of a plurality of potential locations; and

FIG. 15 illustrates sixth, seventh, eighth and ninth image content itemsbeing represented on a display after a search of image content itemsbased on a location of an image of a real object in the fifth imagecontent item.

DESCRIPTION

Embodiments of the invention relate to enabling a user to alter arecording of a real scene in an image content item, and then using thealtered recording to search through and identify further image contentitems. For example, a user may alter a recording of a real scene byexchanging an image of a real object for an image of a different realobject, alter a location of an image of a real object and/or alter asize of an image of a real object.

A technical effect of embodiments of the invention is an improved, moreefficient way of searching though image content items that is intuitiveto the user.

Definitions

In this document, the following definitions apply:

“field of view” refers to extent of the observable world that is visibleto a user at a particular instance in time;

“virtual space” refers to fully or partially artificial environment,which may be three dimensional;

“virtual scene” refers to a representation of the virtual space viewedfrom a particular point of view within the virtual space;

“real space” refers to a real, tangible environment, which may be threedimensional;

“real scene” refers to a portion of the real space as viewed from aparticular point of view within the real space;

“mediated reality” in this document refers to a user visuallyexperiencing a fully or partially artificial environment (a virtualspace) as a virtual scene at least partially displayed by a computer toa user. The virtual scene is determined by a point of view within thevirtual space and a field of view. Displaying the virtual scene meansproviding it in a form that can be seen by the user;

“mediated reality content” is content which enables a user to visuallyexperience a fully or partially artificial environment (a virtual space)as a virtual scene;

“augmented reality” in this document refers to a form of mediatedreality in which a user visually experiences a partially artificialenvironment (a virtual space) as a virtual scene comprising a real sceneof a physical real world environment (real space) supplemented by one ormore visual elements displayed by an apparatus to a user;

“augmented reality content” is a form of mediated reality content whichenables a user to visually experience a partially artificial environment(a virtual space) as a virtual scene;

“virtual reality” in this document refers to a form of mediated realityin which a user visually experiences a fully artificial environment (avirtual space) as a virtual scene displayed by an apparatus to a user;

“virtual reality content” is a form of mediated reality content whichenables a user to visually experience a fully artificial environment (avirtual space) as a virtual scene;

“perspective-mediated” as applied to mediated reality, augmented realityor virtual reality means that user actions determine the point of viewwithin the virtual space, changing the virtual scene;

“first person perspective-mediated” as applied to mediated reality,augmented reality or virtual reality means perspective mediated with theadditional constraint that the user's real point of view determines thepoint of view within the virtual space;

“user interactive-mediated” as applied to mediated reality, augmentedreality or virtual reality means that user actions at least partiallydetermine what happens within the virtual space; and

“displaying” means providing in a form that is perceived visually by theuser.

DETAILED DESCRIPTION

FIGS. 1A-1C and 2A-2C illustrate examples of mediated reality. Themediated reality may be augmented reality or virtual reality.

FIGS. 1A, 1B, 1C illustrate the same virtual space 20 comprising thesame virtual objects 21, however, each figure illustrates a differentpoint of view 24. The position and direction of a point of view 24 canchange independently. The direction but not the position of the point ofview 24 changes from FIG. 1A to FIG. 1B. The direction and the positionof the point of view 24 changes from FIG. 1B to FIG. 1C.

FIGS. 2A, 2B, 2C illustrate a virtual scene 22 from the perspective ofthe different points of view 24 of respective FIGS. 1A, 1B, 1C. Thevirtual scene 22 is determined by the point of view 24 within thevirtual space 20 and a field of view 26. The virtual scene 22 is atleast partially displayed to a user.

The virtual scenes 22 illustrated may be mediated reality scenes,virtual reality scenes or augmented reality scenes. A virtual realityscene displays a fully artificial virtual space 20. An augmented realityscene displays a partially artificial, partially real virtual space 20.

The mediated reality, augmented reality or virtual reality may be userinteractive-mediated. In this case, user actions at least partiallydetermine what happens within the virtual space 20. This may enableinteraction with a virtual object 21 such as a visual element 28 withinthe virtual space 20.

The mediated reality, augmented reality or virtual reality may beperspective-mediated. In this case, user actions determine the point ofview 24 within the virtual space 20, changing the virtual scene 22. Forexample, as illustrated in FIGS. 1A, 1B, 1C a position 23 of the pointof view 24 within the virtual space 20 may be changed and/or a directionor orientation 25 of the point of view 24 within the virtual space 20may be changed. If the virtual space 20 is three-dimensional, theposition 23 of the point of view 24 has three degrees of freedom e.g.up/down, forward/back, left/right and the direction 25 of the point ofview 24 within the virtual space 20 has three degrees of freedom e.g.roll, pitch, yaw. The point of view 24 may be continuously variable inposition 23 and/or direction 25 and user action then changes theposition and/or direction of the point of view 24 continuously.Alternatively, the point of view 24 may have discrete quantisedpositions 23 and/or discrete quantised directions 25 and user actionswitches by discretely jumping between the allowed positions 23 and/ordirections 25 of the point of view 24.

FIG. 3A illustrates a real space 10 comprising real objects 11 that atleast partially corresponds with the virtual space 20 of FIG. 1A. Inthis example, each real object 11 in the real space 10 has acorresponding virtual object 21 in the virtual space 20, however, eachvirtual object 21 in the virtual space 20 does not have a correspondingreal object 11 in the real space 10. In this example, one of the virtualobjects 21, the computer-generated visual element 28, is an artificialvirtual object 21 that does not have a corresponding real object 11 inthe real space 10.

A linear mapping exists between the real space 10 and the virtual space20 and the same mapping exists between each real object 11 in the realspace 10 and its corresponding virtual object 21. The relativerelationship of the real objects 11 in the real space 10 is thereforethe same as the relative relationship between the corresponding virtualobjects 21 in the virtual space 20.

FIG. 3B illustrates a real scene 12 that partially corresponds with thevirtual scene 22 of FIG. 1B, it includes real objects 11 but notartificial virtual objects. The real scene is from a perspectivecorresponding to the point of view 24 in the virtual space 20 of FIG.1A. The real scene 12 content is determined by that corresponding pointof view 24 and the field of view 26.

FIG. 2A may be an illustration of an augmented reality version of thereal scene 12 illustrated in FIG. 3B. The virtual scene 22 comprises thereal scene 12 of the real space 10 supplemented by one or more visualelements 28 displayed by an apparatus to a user. The visual elements 28may be a computer-generated visual element. In a see-througharrangement, the virtual scene 22 comprises the actual real scene 12which is seen through a display of the supplemental visual element(s)28. In a see-video arrangement, the virtual scene 22 comprises adisplayed real scene 12 and displayed supplemental visual element(s) 28.The displayed real scene 12 may be based on an image from a single pointof view 24 or on multiple images from different points of view 24 at thesame time, processed to generate an image from a single point of view24.

FIG. 4A illustrates an apparatus 4 in the form of a chip or a chipset.The illustrated apparatus 4 comprises at least one processor 40 and atleast one memory 46. The processor(s) 40 might be or include a centralprocessing unit (CPU) and/or a graphics processing unit (GPU). Theprocessor 40 is configured to read from and write to the memory 46. Theprocessor 40 may also comprise an output interface via which data and/orcommands are output by the processor 40 and an input interface via whichdata and/or commands are input to the processor 40.

The memory 46 stores a computer program 148 comprising computer programinstructions (computer program code) 48 that controls the operation ofthe apparatus 4/30 when loaded into the processor 40. The computerprogram instructions 48, of the computer program 148, provide the logicand routines that enables the apparatus 4/30 to perform the methodsillustrated in FIGS. 5, 6 and 8. The processor 40 by reading the memory46 is able to load and execute the computer program 148.

The computer program 148 may arrive at the apparatus 4/30 via anysuitable delivery mechanism. The delivery mechanism may be, for example,a non-transitory computer-readable storage medium, a computer programproduct, a memory device, a record medium such as a compact discread-only memory (CD-ROM) or digital versatile disc (DVD), an article ofmanufacture that tangibly embodies the computer program 148. Thedelivery mechanism may be a signal configured to reliably transfer thecomputer program 148. The signal could, for example, be sent over awireless connection (such as a radio frequency connection) or a wiredconnection in accordance with one or more protocols. The apparatus 4/30may cause the computer program 148 to be transmitted as a computer datasignal.

Although the memory 46 is illustrated as a single component/circuitry itmay be implemented as one or more separate components/circuitry some orall of which may be integrated/removable and/or may providepermanent/semi-permanent/dynamic/cached storage.

Although the processor 40 is illustrated as a single component/circuitryit may be implemented as multiple processors, such as one or moreseparate components/circuitry some or all of which may beintegrated/removable. The processor(s) 40 may be single core ormulti-core.

FIG. 4B illustrates a schematic of an apparatus 30 that is operable toenable mediated reality and/or augmented reality and/or virtual reality.

In some embodiments, the apparatus 30 might be a single electronicdevice such as a head-mounted viewing device. An example of such ahead-mounted viewing device is illustrated in FIG. 7B.

In other embodiments, the apparatus 30 could be distributed acrossmultiple devices, which may be formed from a combination of ahead-mounted viewing device, a games console/personal computer and/orone or more hand-held controllers. Where the apparatus 30 is formed atleast in part by a games console or a personal computer, the processor40 and the memory 46 (or, where multiple processors and/or multiplememories are provided, one or more of either or both) may be provided inthe games console/personal computer.

In the illustrated example, the apparatus 30 comprises the apparatus 4illustrated in FIG. 4A, one or more displays 32, one or moretransceivers 42 and user input circuitry 44.

The one or more displays 32 are for providing at least parts of thevirtual scene 22 to a user in a form that is perceived visually by theuser. Such a virtual scene may form part of mediated reality content,such as virtual reality content or augmented reality content. Thedisplay(s) 32 may be one or more visual displays that provides lightwhich displays at least parts of the virtual scene 22 to a user.Examples of visual displays include liquid crystal displays, organiclight emitting displays, emissive, reflective, transmissive andtransflective displays, direct retina projection display, near eyedisplays etc. The display(s) 32 is controlled in this example but notnecessarily all examples by the processor 40.

A head-mounted viewing device moves when the head of the user moves. Thehead-mounted viewing device may be a see-through arrangement foraugmented reality that enables a live real scene 12 to be viewed whileone or more visual elements 28 are displayed by the display(s) 32 to theuser to provide in combination the virtual scene 22. In this case avisor, if present, is transparent or semi-transparent so that the livereal scene 12 can be viewed through the visor.

A head-mounted viewing device may be operated as a see-video arrangementfor augmented reality that enables a live video of a real scene 12 to bedisplayed by the display(s) 32 for viewing by the user while one or morevisual elements 28 are simultaneously displayed by the display(s) 32 forviewing by the user. The combination of the displayed real scene 12 anddisplayed one or more visual elements 28 provides the virtual scene 22to the user. In this case the visor is opaque and may be used as thedisplay(s) 32.

The one or more transceivers 42 are configured to receive inputs fromthe processor 40 to provide outputs to the processor 40. For example,the one or more transceivers 42 may receive data from the processor 40and transmit it, and provide received data to the processor 40.

The one or more transceivers 42 may include one or more wirelesstransceivers and/or one or more wired transceivers. Such wirelesstransceivers may, for example, include radio frequency receivers in theform of one or more long range cellular transceivers or short rangewireless transceivers (which, for example, may operate in accordancewith an Institute of Electrical and Electronic Engineers wireless localarea network 802.11 protocol or a Bluetooth protocol). Such wiredtransceivers may, for example, include a Universal Serial Bus (USB)transceiver.

In the illustrated example, the user input circuitry 44 may comprise oneor more tactile sensors 43, one or more point of view sensors 45 one ormore image sensors 47 for imaging real space 10 and one or more depthsensors 49.

The one or more tactile sensors 43 may include, for example, one or morejoysticks and one or more keys/buttons. The joystick(s) and/or thekey(s)/button(s) may form part of a physical, hand-held controller. Ifthe apparatus 30 is head-mounted, at least some of the one or moretactile sensors 43 may be positioned on the head-mounted apparatus.

The apparatus 30 may enable user-interactive mediation for mediatedreality and/or augmented reality and/or virtual reality. The user inputcircuitry 44 detects user actions using user input, such as via thetactile sensor(s) 43. These user actions are used by the processor 40 todetermine what happens within the virtual space 20. This may enableinteraction with a visual element 28 within the virtual space 20.

The apparatus 30 may enable perspective mediation for mediated realityand/or augmented reality and/or virtual reality. The user inputcircuitry 44 detects user actions. These user actions are used by theprocessor 40 to determine the point of view 24 within the virtual space20, changing the virtual scene 22. The point of view 24 may becontinuously variable in position and/or direction and user actionchanges the position and/or direction of the point of view 24.Alternatively, the point of view 24 may have discrete quantisedpositions and/or discrete quantised directions and user action switchesby jumping to the next position and/or direction of the point of view24.

The apparatus 30 may enable first person perspective for mediatedreality, augmented reality or virtual reality. The user input circuitry44 detects the user's real point of view 14 using user point of viewsensor 45. The user's real point of view is used by the processor 40 todetermine the point of view 24 within the virtual space 20, changing thevirtual scene 22. Referring back to FIG. 3A, a user 18 has a real pointof view 14. The real point of view may be changed by the user 18. Forexample, a real location 13 of the real point of view 14 is the locationof the user 18 and can be changed by changing the physical location 13of the user 18. For example, a real direction 15 of the real point ofview 14 is the direction in which the user 18 is looking and can bechanged by changing the real direction of the user 18. The realdirection 15 may, for example, be changed by a user 18 changing anorientation of their head or view point and/or a user changing adirection of their gaze. A head-mounted apparatus 30 may be used toenable first-person perspective mediation.

The apparatus 30 may comprise as part of the input circuitry 44 point ofview sensors 45 for determining changes in the real point of view.

For example, positioning technology such as GPS, triangulation(trilateration) by transmitting to multiple receivers and/or receivingfrom multiple transmitters, acceleration detection and integration maybe used to determine a new physical location 13 of the user 18 and realpoint of view 14.

For example, accelerometers, electronic gyroscopes or electroniccompasses may be used to determine a change in an orientation of auser's head or view point and a consequential change in the realdirection 15 of the real point of view 14.

For example, pupil tracking technology, based for example on computervision, may be used to track movement of a user's eye or eyes andtherefore determine a direction of a user's gaze and consequentialchanges in the real direction 15 of the real point of view 14.

The apparatus 30 may comprise as part of the input circuitry 44 imagesensors 47 for imaging the real space 10.

An example of an image sensor 47 is a digital image sensor that isconfigured to operate as a camera. Such a camera may be operated torecord static images and/or video images. In some, but not necessarilyall embodiments, cameras may be configured in a stereoscopic or otherspatially distributed arrangement so that the real space 10 is viewedfrom different perspectives. This may enable the creation of athree-dimensional image and/or processing to establish depth, forexample, via the parallax effect.

In some, but not necessarily all embodiments, the input circuitry 44comprises depth sensors 49. A depth sensor 49 may comprise a transmitterand a receiver. The transmitter transmits a signal (for example, asignal a human cannot sense such as ultrasound or infrared light) andthe receiver receives the reflected signal. Using a single transmitterand a single receiver some depth information may be achieved viameasuring the time of flight from transmission to reception. Betterresolution may be achieved by using more transmitters and/or morereceivers (spatial diversity). In one example, the transmitter isconfigured to ‘paint’ the real space 10 with light, preferably invisiblelight such as infrared light, with a spatially dependent pattern.Detection of a certain pattern by the receiver allows the real space 10to be spatially resolved. The distance to the spatially resolved portionof the real space 10 may be determined by time of flight and/orstereoscopy (if the receiver is in a stereoscopic position relative tothe transmitter).

The apparatus 30 may enable mediated reality and/or augmented realityand/or virtual reality, for example using the method 60 illustrated inFIG. 6A or a similar method. The processor 40 stores and maintains amodel 50 of the virtual space 20. The model may be provided to theprocessor 40 or determined by the processor 40. For example, sensors ininput circuitry 44 may be used to create overlapping depth maps of thevirtual space from different points of view and a three dimensionalmodel may then be produced.

At block 62 it is determined whether or not the model of the virtualspace 20 has changed. If the model of the virtual space 20 has changedthe method moves to block 66. If the model of the virtual space 20 hasnot changed the method moves to block 64.

At block 64 it is determined whether or not the point of view 24 in thevirtual space 20 has changed. If the point of view 24 has changed themethod moves to block 66. If the point of view 24 has not changed themethod returns to block 62.

At block 66, a two-dimensional projection of the three-dimensionalvirtual space 20 is taken from the location 23 and in the direction 25defined by the current point of view 24. The projection is then limitedby the field of view 26 to produce the virtual scene 22. The method thenreturns to block 62.

Where the apparatus 30 enables augmented reality, the virtual space 20comprises objects 11 from the real space 10 and also visual elements 28not present in the real space 10. The combination of such visualelements 28 may be referred to as the artificial virtual space. FIG. 5Billustrates a method 70 for updating a model of the virtual space 20 foraugmented reality.

At block 72 it is determined whether or not the real space 10 haschanged. If the real space 10 has changed the method moves to block 76.If the real space 10 has not changed the method moves to block 74.Detecting a change in the real space 10 may be achieved at a pixel levelusing differentiating and may be achieved at an object level usingcomputer vision to track objects as they move.

At block 74 it is determined whether or not the artificial virtual spacehas changed. If the artificial virtual space has changed the methodmoves to block 76. If the artificial virtual space has not changed themethod returns to block 72. As the artificial virtual space is generatedby the controller 42 changes to the visual elements 28 are easilydetected.

At block 76, the model of the virtual space 20 is updated.

In some but not necessarily all embodiments, the input circuitry 44 maycomprise communication circuitry 41 in addition to or as an alternativeto one or more of the image sensors 47 and the depth sensors 49. Suchcommunication circuitry 41 may communicate with one or more remote imagesensors 47 in the real space 10 and/or with remote depth sensors 49 inthe real space 10. The communication circuitry 41 may form part of thetransceiver(s) 42.

FIGS. 7A and 7B illustrate examples of apparatus 30 that enable displayof at least parts of the virtual scene 22 to a user. Other examples ofapparatus 30 that enable display of at least parts of the virtual scene22 to a user may be used.

FIG. 7A illustrates a handheld apparatus 31 comprising a display screenas display 32 that displays images to a user and is used for displayingthe virtual scene 22 to the user. The apparatus 30 may be moveddeliberately in the hands of a user in one or more of the previouslymentioned six degrees of freedom.

The handheld apparatus 31 may be or may be operated as a see-videoarrangement for augmented reality that enables a live video of a realscene 12 to be displayed on the display 32 for viewing by the user whileone or more visual elements 28 are simultaneously displayed on thedisplay 32 for viewing by the user. The combination of the displayedreal scene 12 and displayed one or more visual elements 28 provides thevirtual scene 22 to the user.

If the handheld apparatus 31 has a camera mounted on a face opposite thedisplay 32, it may be operated as a see-video arrangement that enables alive real scene 12 to be viewed while one or more visual elements 28 aredisplayed to the user to provide in combination the virtual scene 22.

FIG. 7B illustrates a head-mounted viewing device 33 comprising adisplay 32 that displays images to a user. The head-mounted apparatus 33may be moved automatically when a head of the user moves.

The head-mounted viewing device 33 may be a see-through arrangement foraugmented reality that enables a live real scene 12 to be viewed whileone or more visual elements 28 are displayed by the display 32 to theuser to provide in combination the virtual scene 22. In this case avisor 34, if present, is transparent or semi-transparent so that thelive real scene 12 can be viewed through the visor 34.

The head-mounted viewing device 33 may be operated as a see-videoarrangement for augmented reality that enables a live video of a realscene 12 to be displayed by the display 32 for viewing by the user whileone or more visual elements 28 are simultaneously displayed by thedisplay 32 for viewing by the user. The combination of the displayedreal scene 12 and displayed one or more visual elements 28 provides thevirtual scene 22 to the user. In this case a visor 34 is opaque and maybe used as display 32.

Referring back to FIG. 4B, the apparatus 30 may enable user-interactivemediation for mediated reality and/or augmented reality and/or virtualreality. The user input circuitry 44 detects user actions from userinput. These user actions are used by the processor 40 to determine whathappens within the virtual space 20. This may enable interaction with avisual element 28 within the virtual space 20.

The detected user actions may, for example, be gestures performed in thereal space 10. Gestures may be detected in a number of ways. Forexample, depth sensors 49 may be used to detect movement of parts a user18 and/or or image sensors 47 may be used to detect movement of parts ofa user 18 and/or positional/movement sensors attached to a limb of auser 18 may be used to detect movement of the limb.

Object tracking may be used to determine when an object or user moves.For example, tracking the object on a large macro-scale allows one tocreate a frame of reference that moves with the object. That frame ofreference can then be used to track time-evolving changes of shape ofthe object, by using temporal differencing with respect to the object.This can be used to detect small scale human motion such as gestures,hand movement, facial movement. These are scene independent user (only)movements relative to the user.

The apparatus 30 may track a plurality of objects and/or points inrelation to a user's body, for example one or more joints of the user'sbody. In some examples, the apparatus 30 may perform full body skeletaltracking of a user's body.

The tracking of one or more objects and/or points in relation to auser's body may be used by the apparatus 30 in gesture recognition andso on.

FIG. 8 illustrates a flow chart of a method according to embodiments ofthe invention. A description of the method follows, with reference toFIGS. 4A to 11.

In the example described below, the apparatus 30 comprises ahead-mounted viewing device that enables a user to view recorded imagecontent items 101-109 in mediated reality. Each of the image contentitems 101-109 is stereoscopic virtual reality content that contains arecording of one or more real scenes. Some or all of the image contentitems 101-109 may have been recorded by a camera of the apparatus 30.Alternatively or additionally, some or all of the image content items101-109 may have been recorded elsewhere.

One or more of the image content items 101-109 may have been recorded ata time prior to it being retrieved from memory 46 and displayed on thedisplay(s) 32. Alternatively or additionally, an image content item101-109 may be recorded in memory 46 and displayed on the display(s) 32at substantially the same time, providing a live video or a current(static) image of a real scene.

The image content items 101-109 are illustrated in FIG. 4B as beingstored in the memory 46 of the apparatus 30. In some embodiments, someor all of the image content items 101-109 may be persistently stored innon-volatile memory of the apparatus 30. In other examples, some or allof the image content items 101-109 may only be transiently stored in theapparatus 30, such as in volatile memory. For instance, the imagecontent items 101-109 may be persistently stored in a remote location(in the “cloud”) transiently stored in the memory 46 of the apparatus 30when the user chooses to retrieve them from the remote location forviewing on the apparatus 30.

FIG. 9 illustrates a recording 161 of a real scene that is provided whenthe processor 40 controls the display(s) 32 to display the first imagecontent item 101. The recording 161 may form the whole or just part ofthe first image content item 101.

In this example, the recording 161 of the real scene is part of motionvideo content that is presented to the user in virtual reality. In orderto display the recording 161 of the real scene, the processor 40performs the method as described above in relation to FIG. 5. Therecording 161 of the real scene includes images 132-135 of multiple realobjects, including an image 131 of a television, an image 132 of a firstornament, an image 133 of a second ornament, an image 134 of a firstpicture frame in portrait configuration and an image 135 of a secondpicture frame in landscape configuration.

The recording 161 of the real scene is a virtual scene, like the virtualscene 22 described above in relation to FIGS. 2A, 2B and 2C. Therecording 161 of the real scene has been formed by recording a realscene, like the real scene 12 described above in relation to FIG. 3B,using a stereoscopic mediated/virtual/augmented reality camera. Theimages 132-135 are virtual objects, like the virtual objects 21described above in relation to FIGS. 1A to 2C, which were formed byrecording real objects, like the real objects 11 described above inrelation to FIG. 3A.

In this example, the processor 40 controls the display(s) 32 tohighlight the images 131-135 of the real objects using the visualindications 141-145 illustrated in FIG. 9. The visual indications141-145 may, for instance, indicate to the user that the images 131-135are alterable by the user. It may be that images of real objects that donot have such a visual indication are not alterable by the user.

A user may provide user input to cause an alteration to be made to therecording 161 of the real scene in the first image content item 101. Inblock 801 in FIG. 8, the processor 40 responds to such user input bymaking an alteration to the recording 161 of the real scene.

FIG. 10 illustrates a user in the process of providing user input toselect and alter the image 131 of the television in the recording 161 ofthe real scene. In this example, the user input that is provided toselect and alter the image is a gesture in the form of a translationinput. A translation input is a continuous displacement input which hasa start location and an end location. A user may provide the input byplacing a user input object (such as a hand or a digit) at the startlocation and moving the user input object to the end location.

FIG. 10 illustrates the start location 151 of the translation input thatis provided by the user. The start location 151 is at or aligned withthe image 131 of the television. For example, in order to align his handwith the image 131 of the television, a user may extend his arm towardsthe image 131 of the television. The processor 40 detects the start ofthe translation input from inputs provided to it by the user inputcircuitry 44 and interprets them as a selection of the image 131 of thetelevision. In this example, when the processor 40 determines that theimage 131 has been selected, the visual indications 142-145 are removedfrom display, but that need not necessarily be the case.

FIG. 11 illustrates the recording 161 of the real scene as the usercompletes the translation input. The user moves the user input objectfrom the start location 151 to the end location 153 as illustrated bythe arrow 152, which completes the translation input. As the user movesthe user input object from the start location 151 to the end location152, the processor 40 causes the image 131 of the television to move onthe display(s) 32 as the user input object moves, so that it seems tothe user as if the image 131 of the television is being dragged by theuser input object. Movement of the image 131 of the television reveals adifferent image 136, which appears from beneath the image 131 of thetelevision. The moving image 131 may then be removed from display by theprocessor 40.

In this example, the image 136 that appears from beneath the movingimage 131 is also an image of a television. It may, for example, be animage 136 of a television that, at some point in time, has beenpositioned in the same location in real space as the televisionrepresented in the moving image 131. For example, it could be an oldertelevision or a newer television than the one depicted in the image 131illustrated in FIG. 10. In this example, the replacement image 136 is animage of a real object of the same type (a television) as the realobject depicted in the removed image 131.

In some circumstances, there may not be an appropriate replacement image136. In such circumstances, the image 131 may not be replaced at all.

It may not be necessary for the replacement image 136 to be of a realobject that is of the same type as the real object depicted in theremoved image 131. Alternatively, the replacement image 136 could of adifferent type of real object that, at some point in time, waspositioned in the same location in real space as the televisionrepresented in the removed image 131. Alternatively, the replacementimage 136 might not be an image of any real object, indicating that thelocation was empty at some point in time.

The processor 40 may, for example, be configured to perform imageprocessing on older and/or newer image content items than the firstimage content item 101 (or cause such image processing to be performedby an apparatus that is different from the apparatus 30, such as aremote server) in order to determine images of objects in those imagecontent items that, at some point in time, have been positioned in thesame real space locations as the images 131-135 of the objects in therecording 161 of the real scene. This image processing may take placeprior to the user input being provided to alter the recording 161 of thereal scene as illustrated in FIGS. 9 and 10, in order to avoid real timeimage processing having to be performed, enabling the processor 40 toexchange images of real objects for one another rapidly when appropriateuser input is provided.

In some embodiments, images of objects that are positioned in the samereal space locations as the objects in the recording 161 of the realscene may be stored as part of the first image content item 101, alongwith the recording 161 of the real scene. Alternatively, the first imagecontent item 101, or metadata associated with it, may include one ormore links to images of those objects in other image content items102-109 (that could be stored in the memory 46 or remotely from theapparatus 30), which are retrieved in response to the user inputprovided by the user in block 801 of FIG. 8.

In some implementations, the processor 40 may enable the user to provideuser inputs to make successive alterations to the recording 161 of thereal scene by providing successive user inputs. For instance, if theuser provides first user input, the processor 40 may cause the image 131of the television to be replaced with the image 136 of the othertelevision as described above. If the user provides second user input(for example, in the same direction), the processor 40 may cause theimage 136 of the other television to be replaced with an image ofanother television (such as an even older television). The second userinput might, for instance, be a translation input in the same directionas that described above in relation to FIGS. 10 and 11, with a startlocation at or aligned with the image 136 of the other television.

When a particular image content item is processed to determine whetherit comprises one or more recordings of real scenes that include imagesof real objects in the same locations as the real objects in therecording 161 of the real scene illustrated in FIGS. 10 and 11, theprocessor 40 may also determine whether that image content item is olderor newer than the image content item. This may enable the processor 40to alter the recording 161 of the real scene by exchanging images ofobjects from a newer recording of the real scene or an older recordingof the real scene depending on the user input provided.

For example, the processor 40 may respond to first user input (forinstance, in a first direction) by replacing an image of a real objectwith an image from an older recording/image content item, and respond tosecond user input (for instance, in a second direction which might beopposite to the first direction direction) by replacing the image of areal object with an image from a newer recording/image content item.

In the context of the illustrated example, translation inputs indifferent directions may cause different images to replace the image ofthe real object. If the user provides a rightwards translation input(rather than the leftwards translation input illustrated in FIGS. 10 and11), the processor 40 may cause the image 141 of the television to bereplaced with a different image from the image 136 illustrated in FIG.11, such as an image of a newer television.

It will be recognized by those skilled in the art that different formsof user input could be provided other than a translation input. Forexample, as described above, the user input could be provided using oneor more tactile sensors 43, which could form part of a hand-heldcontroller.

In block 802 in FIG. 8, the processor 40 determines an alteredcharacteristic of the recording 161 of the real scene. In this example,the altered characteristic could be a time period during which the(original) recording comprising the image 136 of the television wascaptured.

In block 803 in FIG. 8, the processor 40 determines whether one or moreother image content items 102-109, different from the first imagecontent item 101, have a recording of a real scene which comprises thedetermined altered characteristic. As explained above, in this examplethe altered determined characteristic is the time period during whichthe (original) recording comprising the image 136 of the television wascaptured, so the processor 40 searches through one or more other imagecontent items 102-109, different from the first image content item 101,to determine whether any of them have a recording of a real scene thatwas captured during that time period. This could be done by, forexample, analyzing a date stamp of each of the image content items102-109 which may be provided in metadata.

In block 804 in FIG. 8, after determining one or more image contentitems that comprise the altered characteristic in block 803 in FIG. 8,the processor 40 causes that/those image content items to be indicatedto the user. It may, for example, cause images representing one or moreof them to be displayed by the display(s) 32. At least one of the imagecontent items may be different from the image content that the image 136of the older television (illustrated in FIG. 11) was taken from whenaltering the recording 161 of the real scene.

In some embodiments, the processor 40 might also cause image contentitems that do not comprise the altered characteristic to be displayed bythe display(s) 32 (such as those with a date of creation outside thedetermined time period), but might cause image content items thatcomprise the altered characteristic to be displayed more prominently(for example, at the top of a list).

FIG. 12 illustrates an example in which the processor 40 determined thatthe second, third and fourth image content items 102-104 each comprise arecording of a real scene that was captured during the determined timeperiod. The processor 40 causes each of the second, third and fourthimage content items 102-104 to be represented on the display(s) 32 inthis example with a thumbnail image of the recording of the real scenewhich was captured during that time period. The image 136 of the realobject that provided the “seed” for the search is also displayed.

In the example illustrated in FIG. 12, the processor 40 has alsodetermined that the second image content item 102 includes a recordingof a real scene comprising the image 136 of the television that wasrevealed in FIG. 11 and, as a consequence, has displayed an image 162representing the second image content item 102 more prominently than theimages 163, 164 representing the third and fourth image content items103, 104. Alternatively, the most prominent position might be occupiedby an image of the most frequently accessed/played image content item.

The altered characteristic need not be a time period during which the(original) recording comprising the image 136 of the television wascaptured, as described above in relation to block 802 in FIG. 8. Itcould instead be the presence of the image 136 of the older television(which replaces the image 131 of the television illustrated in FIGS. 9and 10), for instance. If so, in block 803 in FIG. 8, the processor 40determines that one or more other image content items 102-109, differentfrom the first image content item 101, have a recording of a real scenethat includes an image of the older television.

In some implementations, in order to determine this, the processor 40may perform image processing on image content items 102-109, which couldbe stored persistently in the memory 46 of the apparatus 30 or in aremote location. In the latter case, the processor 40 may cause thetransceiver(s) 42 to the download image content items 102-109 and storethem (persistently or transiently) for processing by the processor 40.Additionally or alternatively, the processor 40 may cause such imageprocessing to be performed by an apparatus that is different from theapparatus 30, such as a remote server.

In block 804 in FIG. 8, the processor 40 then causes one or more imagecontent items to be indicated to the user which include an image 136 ofthe older television in the manner described above.

FIG. 13 illustrates a recording 165 of a real scene that is providedwhen the processor 40 controls the display(s) 32 to display the fifthimage content item 105. The recording 165 may form the whole or justpart of the first image content item 105.

In this example, the recording 161 of the real scene is part of motionvideo content that is presented to the user in virtual reality. In orderto display the recording 165 of the real scene, the processor 40performs the method as described above in relation to FIG. 5. Therecording 165 of the real scene includes images of multiple realobjects, including an image 137 of a television.

The recording 165 of the real scene is a virtual scene, like the virtualscene 22 described above in relation to FIGS. 2A, 2B and 2C. Therecording 165 of the real scene has been formed by recording a realscene, like the real scene 12 described above in relation to FIG. 3B,using a stereoscopic mediated/virtual/augmented reality camera. Theimages of the real world objects are virtual objects, like the virtualobjects 21 described above in relation to FIGS. 1A to 2C, which wereformed by recording real objects, like the real objects 11 describedabove in relation to FIG. 3A.

As described above in relation to the previous example, the processor 40might control the display(s) 32 to highlight any images of real objectsthat are alterable by the user.

It may be that images of real objects that do not have such a visualindication are not alterable by the user.

The processor 40 again performs the method illustrated in FIG. 8 in thisexample. However, in this example, the user may alter a characteristicof the recording 165 of the real scene by moving at least one image of areal object in the recording 165 to a different location in therecording 165.

A user may provide user input to select an image of a real object tomove in the recording 165 of the real scene. Prior to, during or afterselection of such an image, the processor 40 may cause one or morevisual indications to be displayed to the user, in the recording 165 ofthe real scene, indicating at least one potential location to which theimage may be moved to.

The potential locations of the image 137 of the television/real objectmay be determined by processing image content items before, during orafter any user input is provided by the user to determine whether animage 137 of the television/real world object is present in a recordingof the real scene in those image content items and, if so, the locationof the image of the television/real object.

Such a situation is illustrated in FIG. 14, where the processor 40 hascaused the display(s) 32 to display multiple visual indications 172, 173that indicate potential locations to which the image 137 of thetelevision may be moved to.

Each of the locations indicated by the visual indications 172, 173 maycorrespond with the location of an image of the same real object (inthis case, the television) in a further recording of the real scene inanother image content item.

In block 801 in FIG. 8, the processor 40 responds to user input bymaking an alteration to the recording 165 of the real scene. Thealteration is made by moving the (whole of the) image 137 of thetelevision to a different location in the recording 165. The user inputthat is provided to cause the image 137 of the television to move may bea translation input of the form described above, which has a startlocation at or aligned with the image 137 and an end location at oraligned with the location to which the image 137 is moved.

In block 802 in FIG. 8, the processor 40 determines an alteredcharacteristic of the recording 165 of the real scene. In this example,the altered characteristic is the new location of the image 137 of thetelevision.

In block 803 in FIG. 8, the processor 40 determines that one or moreother image content items, different from the fifth image content item105, have a recording of a real scene which comprises the determinedaltered characteristic.

In block 804, the processor 40 then causes one or more image contentitems to be indicated to the user which include an image of thetelevision/real object in the new location in a recording of the realscene.

The upper left hand side of FIG. 15 illustrates the recording 165 of thereal scene illustrated in FIGS. 13 and 14 prior to any alteration beingmade to the recording 165 of the real scene. Beneath that, in thisexample, the processor 40 has caused the display(s) 32 to display images166, 167 of recordings of the real scene provided in sixth and seventhimage content items 106, 107 that include the image 137 of thetelevision/real object in its original location.

The right hand side of FIG. 15 illustrates the recording 165 of the realscene illustrated in FIGS. 13 and 14 after the recording 165 of the realscene has been altered by moving the position of the image 137 of thetelevision to that indicated by the visual indication labelled with thereference numeral 172. Beneath that, in this example, the processor 40has caused the display(s) 32 to display images 168, 169 of recordings ofthe real scene provided in eighth and ninth image content times 108, 109that include the image 137 of the television/real object in its alteredlocation.

Embodiments of the invention are not limited to the alteration of therecording of real scenes in the manner described above. For example, insome embodiments of the invention, a size of an image of a real objectmight be altered, which causes the processor 40 to control thedisplay(s) 32 to indicate one or more image content items to the userwhich include an image of the real object with the altered size.

In these embodiments, the real object could be a person. Altering thesize of the image of the person may cause the processor 40 to search forimage content items which include an image of the person where theperson is smaller/younger or taller/older.

In order to do this, the processor 40 may determine a real size of thereal object/person shown in the original recording. This could be done,for example, by using metadata associated with an image content itemwhich might indicate, for example, optical properties of the camera usedto capture the relevant recording and the distance of the realobject/person from the capturing device when the recording was captured.

The processor 40 may then use the determined real size of the realobject/person to determine a real size which corresponds with thealtered size of the image of the real object/person, and compare thatwith determined real sizes of images of the real object/person inrecordings of real scenes in other image content items.

In summary, embodiments of the invention provide a particularlyefficient and intuitive way of enabling a user to search through imagecontent items, where images of real objects effectively serve as contentindices/links to other image content items.

A user may, for example, be able to find image content items easily thatwere captured in the same location and/or in the same time period asanother image content item without having to recall exactly when theearlier image content items were captured and/or exactly where they arestored.

For example, a user may be able to recollect that a particular imagecontent item was recorded when he owned his old television, but notrecall exactly where it is stored. Embodiments of the present inventioncan help him to perform a search to find it in a intuitive way.

References to ‘computer-readable storage medium’, or a ‘computer’,‘processor’ etc. should be understood to encompass not only computershaving different architectures such as single/multi-processorarchitectures and sequential (Von Neumann)/parallel architectures butalso specialized circuits such as field-programmable gate arrays (FPGA),application specific circuits (ASIC), signal processing devices andother processing circuitry. References to computer program,instructions, code etc. should be understood to encompass software for aprogrammable processor or firmware such as, for example, theprogrammable content of a hardware device whether instructions for aprocessor, or configuration settings for a fixed-function device, gatearray or programmable logic device etc.

As used in this application, the term ‘circuitry’ refers to all of thefollowing:

(a) hardware-only circuit implementations (such as implementations inonly analog and/or digital circuitry) and(b) to combinations of circuits and software (and/or firmware), such as(as applicable): (i) to a combination of processor(s) or (ii) toportions of processor(s)/software (including digital signalprocessor(s)), software, and memory(ies) that work together to cause anapparatus, such as a mobile phone or server, to perform variousfunctions and(c) to circuits, such as a microprocessor(s) or a portion of amicroprocessor(s), that require software or firmware for operation, evenif the software or firmware is not physically present.

This definition of ‘circuitry’ applies to all uses of this term in thisapplication, including in any claims. As a further example, as used inthis application, the term “circuitry” would also cover animplementation of merely a processor (or multiple processors) or portionof a processor and its (or their) accompanying software and/or firmware.The term “circuitry” would also cover, for example and if applicable tothe particular claim element, a baseband integrated circuit orapplications processor integrated circuit for a mobile phone or asimilar integrated circuit in a server, a cellular network device, orother network device.

The blocks illustrated in FIGS. 5, 6 and 8 may represent steps in amethod and/or sections of code in the computer program 148. Theillustration of a particular order to the blocks does not necessarilyimply that there is a required or preferred order for the blocks and theorder and arrangement of the block may be varied. Furthermore, it may bepossible for some blocks to be omitted.

Where a structural feature has been described, it may be replaced bymeans for performing one or more of the functions of the structuralfeature whether that function or those functions are explicitly orimplicitly described.

Although embodiments of the present invention have been described in thepreceding paragraphs with reference to various examples, it should beappreciated that modifications to the examples given can be made withoutdeparting from the scope of the invention as claimed. For example, whilethe image content items are described above as stereoscopic virtualreality content items that are viewed using a head-mounted viewingdevice, this need not necessarily be the case.

In some implementations, the image content items might be instead bestereoscopic augmented reality content items and in otherimplementations the image content items might not be stereoscopic.

There may be different ways of making alterations to a recording of areal scene other than those described above. For example, details couldbe added or removed from images of real objects (such as adding orremoving glasses to/from a person) or colors of images of real objectscould be changed.

In some implementations, more than one alteration may be made to arecording of a real scene.

Features described in the preceding description may be used incombinations other than the combinations explicitly described.

Although functions have been described with reference to certainfeatures, those functions may be performable by other features whetherdescribed or not.

Although features have been described with reference to certainembodiments, those features may also be present in other embodimentswhether described or not.

Whilst endeavoring in the foregoing specification to draw attention tothose features of the invention believed to be of particular importanceit should be understood that the applicant claims protection in respectof any patentable feature or combination of features hereinbeforereferred to and/or shown in the drawings whether or not particularemphasis has been placed thereon.

I/We claim: 1-15. (canceled)
 16. A method, comprising: responding touser input by making at least one alteration to a recording of a realscene in a first image content item; determining at least one alteredcharacteristic of the recording of the real scene; determining that oneor more further image content items, different from the first imagecontent item, have a recording of a real scene comprising the at leastone determined altered characteristic; and causing at least one furtherimage content item, having a recording of a real scene comprising the atleast one determined altered characteristic, to be indicated to a user.17. The method of claim 16, wherein the first image content item isstereoscopic mediated reality content, and the further image contentitems are stereoscopic mediated reality content items.
 18. The method ofclaim 16, further comprising: causing a visual indication to be providedto a user indicating that an image of a real object in the recording ofthe real scene is alterable, prior to the user input being provided. 19.The method of claim 16, wherein determining that one or more furtherimage content items have a recording of a real scene comprising the atleast one determined altered characteristic comprises determining datesof creation of the further image content items.
 20. The method of claim16, wherein making the alteration to the recording of a real scenecomprises altering a location of an image of a real object in therecording of the real scene by moving the whole of the image of the realobject from a first location to a second location.
 21. The method ofclaim 20, further comprising: causing one or more visual indications tobe displayed to a user, in the recording of the real scene, indicatingat least one potential location to which the image of the real object ismovable, wherein the at least one potential location to which the imageof the real object is movable corresponds with a location of an image ofthe real object in a further recording of the real scene in at least oneof the further image content items.
 22. The method of claim 16, whereinmaking the alteration to the recording of the real scene comprisesaltering a size of an image of a real object.
 23. The method of claim22, further comprising: determining a real size of the real object;determining a real size corresponding with the altered size of the imageof the real object, based on the determined real size and the user inputprovided to alter the size of the image of the real object, whereindetermining whether one or more further image content items, differentfrom the first image content item, have a recording of a real scenecomprising the determined altered characteristic comprises comparingdetermined real sizes of real objects with the real size correspondingwith the altered size of the image of the real object.
 24. The method ofclaim 23, wherein the image of the real object in the first imagecontent item is a person.
 25. The method of claim 16, wherein making thealteration to the recording of the real scene comprises exchanging animage of a real object with a different image of a real object of thesame type.
 26. An apparatus comprising at least one processor and atleast one memory, the memory comprising machine-readable instructions,that when executed cause the apparatus to: respond to user input bymaking at least one alteration to a recording of a real scene in a firstimage content item; determine at least one altered characteristic of therecording of the real scene; determine that one or more further imagecontent items, different from the first image content item, have arecording of a real scene comprising the at least one determined alteredcharacteristic; and cause at least one further image content item,having a recording of a real scene comprising the at least onedetermined altered characteristic, to be indicated to a user.
 27. Theapparatus of claim 26, wherein the first image content item isstereoscopic mediated reality content, and the further image contentitems are stereoscopic mediated reality content items.
 28. The apparatusof claim 26, further caused to: cause a visual indication to be providedto a user indicating that an image of a real object in the recording ofthe real scene is alterable, prior to the user input being provided. 29.The apparatus of claim 26, wherein determining that one or more furtherimage content items have a recording of a real scene comprising the atleast one determined altered characteristic comprises determining datesof creation of the further image content items.
 30. The apparatus ofclaim 26, wherein making the alteration to the recording of a real scenecomprises altering a location of an image of a real object in therecording of the real scene by moving the whole of the image of the realobject from a first location to a second location.
 31. The apparatus ofclaim 30, further caused to: cause one or more visual indications to bedisplayed to a user, in the recording of the real scene, indicating atleast one potential location to which the image of the real object ismovable, wherein the at least one potential location to which the imageof the real object is movable corresponds with a location of an image ofthe real object in a further recording of the real scene in at least oneof the further image content items.
 32. The apparatus of claim 26,wherein making the alteration to the recording of the real scenecomprises altering a size of an image of a real object.
 33. Theapparatus of claim 32, further caused to: determine a real size of thereal object; determining a real size corresponding with the altered sizeof the image of the real object, based on the determined real size andthe user input provided to alter the size of the image of the realobject, wherein determining whether one or more further image contentitems, different from the first image content item, have a recording ofa real scene comprising the determined altered characteristic comprisescomparing determined real sizes of real objects with the real sizecorresponding with the altered size of the image of the real object. 34.The apparatus of claim 26, wherein making the alteration to therecording of the real scene comprises exchanging an image of a realobject with a different image of a real object of the same type.
 35. Atleast one non-transitory computer readable medium comprisinginstructions that, when executed, perform: respond to user input bymaking at least one alteration to a recording of a real scene in a firstimage content item; determine at least one altered characteristic of therecording of the real scene; determine that one or more further imagecontent items, different from the first image content item, have arecording of a real scene comprising the at least one determined alteredcharacteristic; and cause at least one further image content item,having a recording of a real scene comprising the at least onedetermined altered characteristic, to be indicated to a user.